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METHOD AND APPARATUS FOR ADAPTIVE SERVICES NETWORKING 



1 5 CLAIM TO BENEFIT OF EARLIER FILED U.S. PROVISIONAL APPLICATIONS 
This utility Patent Application claims the benefit of the filing date of the 
following earlier filed U.S. Provisional Patent Applications: 

1) "METHODS AND APPARATUS FOR ADAPTIVE SERVICES 
NETWORKING" filed January 13, 2003 having U.S. Serial No. 60/439,763; and 
20 2) "METHODS AND APPARATUS FOR INSERTING A FILE SERVER 

LOAD BALANCING DEVICE INTO A NETWORK" filed August 28, 2003 having 
U.S. Serial No. 60/498,475. 

These utility Patent Applications share co-inventorship with this referenced 
Provisional Patent Application and are assigned to the same assignee. The entire 
25 teachings and contents of these referenced Provisional Patent Applications are hereby 
incorporated herein by reference in their entirety. 



Attorney Docket: ACO03-02 

2 

BACKGROUND 

Conventional computer networking environments support the exchange of 
information between many interconnected computer systems. In a typical conventional 
computer networking environment, one or more client computer systems operate client 

5 software applications that transmit data access requests using a variety of data 

communications protocols over the computer network to server computer systems (i.e., 
servers) for receipt by server software applications executing on those servers. The 
server software applications receive the client data access requests and process these 
requests to access (e.g., read and/or write) data stored within data storage systems, such 

10 as disk drives or other mass storage systems, coupled to the server computer systems. 
The server computer systems transmit the requested data in a server response back to the 
client computer systems for receipt by the client software applications. In this manner, 
client/server software applications can effectively exchange data. 

An example of popular conventional client/server information exchange system is 

15 provided by client and server software applications and an exchange protocol collectively 
referred to as the Network File System (NFS), originally developed by Sun Microsystems 
Inc. of Palo Alto, California, USA. Another example of such a conventional client-server 
system is the Common Internet File System (CIFS) created by Microsoft Corp. of 
Redmond, Washington, USA. 

20 Generally, both NFS and CIFS provide respective client and server software 

portions (i.e., programs) that are typically integrated into the operating system of a 
computer to allow the computer system to export or remotely provide access to file and 
directories arranged within a file system managed by the operating system of that - 
computer system. NFS is typically provided in standard distributions of the UNIX 

25 operating system, while CIFS provides similar functionality to that of NFS but for the 
Windows series of operating systems produced by Microsoft Corporation. Software 
developers have created implementations of NFS and CIFS that work in both UNIX and 
Windows-based computing system environments as well. 

Other types of conventional data and information exchange systems include those 

30 provided by a set of applications and protocols collectively referred to as the World Wide 
Web. The World Wide Web most commonly operates over a collection of interconnected 
computer networks known as the Internet. In a typical implementation of the World 
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Wide Web, client computer systems operate a client software application referred to as a 
web browser. A typical web browser operates to provide hypertext transport protocol 
(HTTP) requests for documents referred to as web pages over the computer network to 
web server computer systems. A web server software application operating in the web 

5 server computer system can receive and process an HTTP web page request and can 
return or "serve" a corresponding web page document or file specified in the client 
request back to the requesting client computer system over the computer network for 
receipt by the web browser. The web browser can interpret markup language such as the 
hypertext markup language (HTML) or the extensible markup language (XML) within 

10 the web page in order to render information such as text, graphics or multimedia 

information to the user of the web browser on a display of the client computer system. A 
collection of related web page documents that clients can access at a common network 
address or domain name on a network is generally referred to as a web site. 

In addition to simply accessing web pages, more recent conventional software and 

1 5 networking technologies that work in conjunction with protocols such as HTTP provide 
services, known as "web services", over a computer network such as the Internet. In a 
web services architecture, a server computer system can provide access to processing 
functionality using a scripting (i.e., programming) language called the Web Services 
Description Language (WSDL). A particular service expressed in WSDL can provide 

20 some processing functionality. Other computer systems that want to access this 

functionality can discover and invoke the web service offered by the server by submitting 
requests for the service to the server using XML data encoded in a Simple Object Access 
Protocol (SOAP) transferred to the server over HTTP. The XML/SOAP/HTTP web 
services architecture allows distributed computing servers to share processing 

25 functionality with other computers. When a server receives an invocation of a web 

service via an XML message encoded using SOAP, the server can decode the XML data, 
perform the service (i.e., some processing) on the data, and can return the result to the 
requesting computer system (i.e., a client). 

Conventional server computer systems used in client/sever architectures are 

30 typically configured as powerful computer systems containing one or more high- 
performance central processing units or processors, significant amounts of memory, and 
provide access to high-capacity data storage systems for persistent storage of files, 
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databases or other data. In many conventional configurations, a single server computer 
system and associated storage devices does not provide enough processing or storage 
capacity to meet the demand of a particular application. In such cases, system developers 
frequently provide for arrangements of a plurality of server computer systems within a 

5 tightly controlled local area network. Access to the collection of server computer 

systems can be controlled through networked data communications devices such as load 
balancers that can spread or distribute a series of client requests for data across the group 
of server computer systems such that no one particular server computer system is 
overburdened with client requests for data or services. 

10 As an example, consider a popular web site that receives a large number of 

requests from client computer systems for web pages to be served from that site. In such 
a situation, an owner or developer of that web site may provide several server computer 
systems and respective server storage devices that are redundantly configured to each 
service client requests for web pages from that web site. A data communications device 

15 such as a specialized network router or switch can be configured as a load balancer to 
receive client requests from the computer network such as the Internet and distribute 
these requests evenly to each of the web servers. Since each web server contains its own 
duplicate copy of the web site information, each web server is able to service all client 
requests and thus the performance of the web site from the perspective of requesting 

20 client computer systems is improved by the existence of multiple server computer 
systems. 

Typical conventional load balancing algorithms can evenly distribute client 
requests for data across the set of available server computer systems. More advanced 
conventional implementations of load balancing can account for server performance 

25 considerations and can distribute a higher number of client requests to servers that are 
experiencing better performance whereas servers that are experiencing worse 
performance can receive a proportionally smaller number of client requests. 

Even more recent designs of information serving systems provide for "content 
aware" load balancers that perform content aware switching of requests for data or 

30 services. A server installation that provides a content aware load balancer allows 

different servers to store different information that may be requested by client computer 
systems. As client requests arrive at the content aware load balancing device, the content 
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aware load balancer can inspect portions of the client request relating to the data being 
requested, such as portions of a Uniform Resource Locator (URL, and in response, can 
choose which particular server computer system should handle a particular client request 
based on the content (e.g., one or more portions of the URL) of the request itself, as well 
5 as taking into account the availability or performance of the servers. Conventional 

content aware request processing allows a web site administrator to configure the servers 
so that some servers only serve certain portions of data that clients may request while 
other servers serve other portions of data. Thus each server does not have to be 
identically configured. 

10 

SUMMARY OF THE INVENTION 

Conventional mechanisms that provide the ability for computer systems to access 
data within a plurality of server computer systems may experience a variety of 
deficiencies. In conventional arrangements that do not use content aware switching, all 

1 5 servers must be identically configured since a conventional load balancer may distribute 
any client request for processing by any server computer system. Identically configured 
server computer systems provide for an inefficient use of server storage space and 
processing resources. In addition, maintaining duplicate file systems and data within 
each server can create configuration management problems such as having to consistently 

20 update the data on each server so that all servers are always configured the same. 

Conventional content aware load balancing implementations also suffer from 
deficiencies since an administrator must configure the content aware load-balancing 
device (e.g., a switch) as well as each of the server computer systems in a consistent 
manner to ensure that the configuration of the servers is consistent with configuration of 

25 the content aware switch. During the configuration process, the administrator must have 
knowledge of what portions of data will be contained within which servers in order to 
properly configure the load balancing device to perform correct content aware switching 
or routing of client requests. Proper configuration ensures this device will properly route 
the client requests for the appropriate data to the appropriate server. Once configured, a 

30 content aware load balancing device operating as a front-end for a group of servers can 
enable requests from the same client to be directed to a single server thus enabling that 
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server to maintain state information about a client communications session even though 
the communications protocol used to transport the client requests may be stateless. 

However, content aware load balancing implementations still require significant 
human management and involvement in order to pre-configure data at each server 
5 computer system in a coordinated manner with the content aware load balancing device 
in order to function properly. Further still, as client demands for access to certain data 
within a group of server computer systems changes over time (e.g., certain data in one 
server is requested much more frequently than other data from other servers), such 
conventional content aware load balancing implementations are not able to adapt well to 

10 such changing demands. Information system designers have observed that in many 
client/server information systems, 90 percent of client requests are directed to only 10 
percent of the data served by a group of servers. Since information that is most 
frequently requested by client computer systems can change over a period of time, 
conventional client/server implementations do not provide an efficient mechanism to 

1 5 dynamically adapt to these demand changes. Such systems rely largely on human 
intervention to maintain the configuration of the appropriate portions of frequently 
accessed data stored within multiple server computer systems. Administrator of such 
conventional systems can use performance management tools that perform such tasks as 
data access log analysis to identity those portions of data that are most sought after. 

20 Embodiments of the invention significantly overcome these and other deficiencies 

of conventional data access systems and provide an adaptive load balancing device that 
operates within a networked computing system environment that includes mechanisms 
and techniques for receiving and processing client data access transactions for data 
provided within a plurality of server computer systems coupled to the adaptive load 

25 balancer. The adaptive load balancer of this invention thus presents, to the client 

computer systems, a collective or aggregated set of data systems (e.g., file systems or 
web services) operating within respective server computer systems as a single virtual data 
system (e.g., as a single file system or web service) to the client computer systems. The 
client computer systems need not have any knowledge of the existence of the individual 

30 respective server computer systems that operate separate server data systems. 

As an example, one or more adaptive load balancers can be configured to operate 
in conjunction with a plurality of server computer systems to provide access, on behalf of 
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client computer systems, to an aggregated file system referred to herein as a virtual file 
system. The virtual file system represents an aggregation of a collective set of files 
available within each server file system maintained by each server computer system. The 
adaptive load balancer can use a data access protocol such as NFS or CIFS to provide 
5 access to and management of respective individual files stored within a collection of 
server file systems. 

Continuing the file system example, the adaptive load balancer of this invention 
maintains state information referred to as metadata that contains information concerning 
the locations of particular individual files within particular server file systems of 

10 respective server computer systems. In addition, the metadata maintains translation 

information that the adaptive load balancer uses to map client data access transactions to 
server data access transactions for access to particular files according to data access 
operations specified by the client. In other words, the adaptive load balancer configured 
in accordance with embodiments of the invention maintains the metadata to map client 

1 5 data access requests or transactions such as NFS file access operations (or web services 
requests in a web services configuration) to corresponding server data access transactions 
and to perform a reverse translation from server responses back to client responses. 

This translation process as will be explained herein can involve mapping virtual 
file system parameters specified in the client data access transactions into physical file 

20 system parameters of a particular server file system for access to a particular file stored 
by one of the server computer systems. In addition, the translation process can include 
identifying which particular server computer system maintains a version of the file to be 
accessed. Once mapped to a server data access transactions, the adaptive load balancer 
can use a data access protocol, such as, for example NFS or CIFS, to access the file 

25 within the appropriate server file system and can receive a server data access responds. 
Upon receipt of the server response, the adaptive load balancer can translate, using the 
metadata, the server data access response into a client data access response and can 
transmit or otherwise forward this client response back to the original requesting client 
computer system. In this manner, embodiments of the invention of provide access by 

30 client computer systems to the virtual file system while insulating the client from details 
associated with accessing the particular requested file within a particular server computer 
system. 
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Also as will be explained herein, embodiments of the invention provide for 
dynamic replication and migration of files across multiple server file systems. As an 
example, the adaptive load balancer can detect trends of access to particular information, 
files or other data or services provided within the virtual file system. Such trends can 

5 include, for example, an increase in demand for access to a file or a decrease in such 
demand. Based on detecting such a trend in file, data or web service access by clients, 
embodiments of invention are capable of dynamically responding to the trend by, for 
example, replicating a popular or highly sought after file or group of files or web service 
data to a number of other server computer systems in order to distribute processing load 

10 more evenly within the plurality of server computer systems in order to more efficiently 
service client data access transactions for access to this particular set of files, data or 
service. 

Embodiments of the invention are not limited to an adaptive load balancer that 
aggregates server file systems. Embodiments of the invention are also applicable to other 

1 5 types of data processing systems available from server computer systems such as, for 
example, web services that are available from a group of server computer systems. In 
such embodiments, the adaptive load balancer can appear to client computer systems as a 
single server computer system that provides a collective or aggregated set of Web 
services as a single virtual web service that, in actuality, is operating or is physically 

20 provided by a collection of server computer systems each supporting a respective web 
service. In such a configuration, the adaptive load balancer can receive web service 
transactions such as XML web services messages transmitted to the adaptive load 
balancer over the Simple Object Access Protocol (SOAP) and HTTP. The adaptive load 
balancer maintains metadata that provides a web services mapping from the client data 

25 access transactions containing data access operations that include client web services 
messages to corresponding messages sent to a selected web service server or servers. 

Embodiments of the invention include the methods of processing information as 
explained herein. In addition, other embodiments include an adaptive load balancer that 
is a computerized device, such as data communications device, network device (e.g., 

30 router, switch, gateway, firewall, etc.) or other computerized device configured to process 
some or all of the method and processing operations disclosed herein as embodiments of 
the invention. In such embodiments, a computerized adaptive load balancing device 
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includes a memory system, a processing unit (e.g., Central Processing Unit, controller, 
etc.), a communications interface and an interconnection mechanism connecting these 
components. The memory system is encoded with an adaptive transaction processing 
application that when performed on the processing unit, produces an adaptive transaction 

5 process that operates as explained herein to perform the method embodiments and 
operations explained herein as embodiments of the invention. 

Other arrangements of embodiments of the invention that are disclosed herein 
include software programs to perform the method embodiment steps and operations 
summarized above and disclosed in detail below for the adaptive load balancer and 

1 0 adaptive transaction process. More particularly, a computer program product is disclosed 
that has a computer-readable medium including computer program logic encoded thereon 
that when performed in a computerized device provides associated operations of the 
adaptive transaction process as explained herein. The computer program logic, when 
executed on at least one processor with a computing system, causes the processor to 

1 5 perform the operations (e.g., the methods) indicated herein as embodiments of the 

invention. Such arrangements of the invention are typically provided as software, code 
and/or other data structures arranged or encoded on a computer readable medium such as 
an optical medium (e.g., CD-ROM), floppy or hard disk or other a medium such as 
firmware or microcode in one or more ROM or RAM or PROM chips or as an 

20 Application Specific Integrated Circuit (ASIC) or as downloadable software images in 
one or more modules, shared libraries, etc. 

The software or firmware or other such embodiments can be installed onto a 
computerized device to cause one or more processing units in the computerized device to 
perform the techniques explained herein as embodiments of the invention. Software 

25 processes that operate in a collection of computerized devices, such as in a group of 
adaptive load balancers are also considered an embodiment of the invention. 
Embodiments of the invention include a plurality (e.g., two or more) adaptive load 
balancers working in conjunction with each other, or can comprise a single adaptive load 
balancer operating as explained herein. 

30 It is to be understood that the system of the invention can be embodied strictly as 

a software program, as software and hardware, or as hardware alone. Example 
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embodiments of the invention include an adaptive load balancer manufactured by Acopia 
Networks, Inc. of Chelmsford, Massachusetts, USA. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 The foregoing and other objects, features and advantages of the invention will be 

apparent from the following more particular description of preferred embodiments of the 
invention, as illustrated in the accompanying drawings in which like reference characters 
refer to the same parts throughout the different views. The drawings are not necessarily 
to scale, with emphasis instead being placed upon illustrating the embodiments, 

1 0 principles and concepts of the invention. 

Figure 1 illustrates an example network and computing system environment 
including an adaptive load balancer configured to operate according to embodiments of 
the invention. 

Figure 2 is a flow chart of processing steps that show the general operation of an 
1 5 adaptive transaction process operating in an adaptive load balancer configured to process 
client data access requests according to embodiments of the invention. 

Figure 3 is a flow chart of processing steps that show operation of translation of a 
client transaction into a server transaction and submission to a server computer system 
from an adaptive load balancer configured according to embodiments of the invention. 
20 Figure 4 is a flow chart of processing steps that shows maintaining metadata 

forwarding tables in an adaptive load balancer configured according to embodiments of 
the invention. 

Figure 5 is a flow chart of processing steps for receiving a client data access 
transaction in an adaptive load balancer configured according to embodiments of the 
25 invention. 

Figures 6A and 6B are a flow chart of processing steps for translating client data 
access transactions in an adaptive load balancer configured according to embodiments of 
the invention. 

Figure 7 is a flow chart of processing steps for forwarding translated server data 
30 access transactions to a server computer system and receiving a server response in an 
adaptive load balancer configured according to embodiments of the invention. 
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Figure 8 is a flow chart of processing steps that show translation of a server 
transaction response into a client transaction response and forwarding to a client 
computer system from adaptive load balancer configured according to embodiments of 
the invention. 

5 Figure 9 is an example computing system architecture showing operation of 

multiple adaptive load balancers in conjunction with each other in accordance with 
embodiments of the invention. 

Figures 10 and 1 1 are flow charts of processing steps for detecting a data access 
trend and performing a migration operation of data in an adaptive load balancer 
1 0 configured according to embodiments of the invention. 

Figure 12A is a flow chart of processing steps for processing metadata-only 
transactions in an adaptive load balancer configured according to embodiments of the 
invention. 

Figure 12B is a flow chart of processing steps that show processing an NFS 
1 5 STATFS operation in an adaptive load balancer configured according to embodiments of 
the invention. 

Figures 13 and 14 are a flow chart of processing steps for processing file access 
operations when replicated files exist in an adaptive load balancer configured according 
to embodiments of the invention. 

20 

DETAILED DESCRIPTION 

Generally, embodiments of the invention provide an adaptive load balancing 
device that operates within a networked computing system environment to present, to 
client computer systems, a collective or aggregated set of server data systems operating 

25 within respective server computer systems as a single virtual data system available from 
the adaptive load balancer to the client computer systems. One or more adaptive load 
balancers configured in accordance with embodiments of the invention can operate 
collectively as a front-end or access point for files or services provided from a plurality of 
server computer systems without the clients requiring knowledge of each server file 

30 system. Client computer systems submitting client data access transactions (i.e., client 
requests) to an adaptive load balancer of this invention essentially perceive that the 
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adaptive load balancer(s) is/are one large server computer system for all effective 
purposes. 

In addition, in other embodiments of the invention, multiple adaptive load 
balancers can operate in conjunction with each other to provide dynamic and adaptive 

5 replication and migration processing of data such as files across a plurality of server 
computer systems to allow the system to automatically adjust to changes in demands or 
requirements to access certain data, files or services. As an example, using two or more 
adaptive load balancers that each provide access to the virtual file system for a respective 
set of server files systems operating in respective groups of server computer systems 

10 associated with each adaptive load balancer, if a first adaptive load balancer detects an 
increase in demand for certain files within its virtual file system, the first adaptive load 
balancer can replicate (i.e., copy) those files to the virtual file system of the second 
adaptive load balancer so that client requests can be served by both adaptive load 
balancers. This allows a data, file or service serving system using adaptive load 

1 5 balancers of this invention to automatically adapt to changing network conditions. The 
results is the ability to efficiently and automatically respond to changes in demands for 
access to data, files or services without significant human intervention (e.g., without 
having to manually replicate and then de-replicate copies of files as access demands 
increase, and then decrease). 

20 In addition, one or more adaptive load balancers of this invention can provide for 

different classes of data storage and data virtualization by providing, for example, 
replication and/or migration of data (e.g., files or web services data) between a plurality 
of back end data (e.g., file or web services) servers. As an example, when replication is 
performed as explained herein by a single adaptive load balancer, additional copies of 

25 frequently accessed data are made on multiple server file systems of respective back-end 
file servers. Once this is done, new client requests for data are spread across the multiple 
server file systems that have the copies, thus distributing the load of access to this 
replicated data. As another example that will be explained in more detail herein, if some 
servers have fast file systems while others have lesser performing or slower file systems 

30 (or the server computers themselves are slower), the adaptive load balancer can select the 
higher performing servers to obtain the replicated copies of the file or other data for faster 
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access in serving virtual client requests for this data that are spread across the fast servers 
containing the replicated copies (as opposed to the slower servers). 

Figure 1 illustrates an example of a computing system environment 100 suitable 
for use in explaining example operations of embodiments of the invention. The 

5 computing system environment 100 includes a communications network 1 10 such as a 
local area computer network or wide area computer network (e.g., LAN, WAN or the 
Internet) that interconnects and supports communications between a plurality of client 
computer systems 120-1 through 120-M and an adaptive load balancer 130 configured in 
accordance with embodiments of the invention. A local area network 160 interconnects 

1 0 and supports communications between the adaptive load balancer 1 30 and a plurality of 
server computer systems 170-1 through 170-N. Each server computer system 170-1 
through 170-N maintains a respective server data system 175-1 through 175-N (e.g., a 
server file system) that provides access to a respective set of data 180-1 through 180-N 
(e.g., files) stored within a respective server data storage system 190-1 though 190-N. 

1 5 The adaptive load balancer 130 operates an adaptive transaction processor 1 3 1 

that performs processing of the invention as explained herein to provide or present a 
virtual data system 135 (e.g., a virtual file system or virtual web service system) 
accessible to client applications 125 that execute on the client computer systems 120. 
The client computer systems 120 may be any type of computerized device that requires 

20 access to files, data, services or other information provide by the adaptive load balancer 
120 within the virtual data system 135 as explained herein via the use of one or more 
appropriate data access protocols. 

As an example, the virtual data system 135 may be a virtual file system and the 
client computer systems 120 may be personal computers, workstations or the like that 

25 operate client applications 125 that require access to files within the virtual file system. 
An operating system (not specifically enumerated in Figure 1) executing within a client 
computer system 120 can use a network file access protocol such as NFS or CIFS to 
transmit client data (i.e., file) access transactions 1 15 containing data access operations 
117 over the network 1 10 to the adaptive load balancer 130 for access to files exported 

30 within the virtual file system 135 according to those operations 1 17. 

To provide the aggregation of the server file systems 155 into a single virtual file 
system 135, the adaptive transaction processor 131 maintains metadata 132 that includes 
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information for mapping or translating the client data access transactions 1 15 and 
associated data access operations 117, such as NFS file access requests, into server data 
access transactions 145. The metadata 132, as will be explained in more detail, contains 
virtual data system to server data system parameter mapping information. As an 

5 example, in embodiments that provide a virtual file system 135, the metadata 132 

provides a mapping of virtual file (and directory) handle parameters, specified within an 
NFS or CIFS file access operation 117 (contained within a client file access transaction 
115) received from a client computer system 120, to corresponding server file system file 
(or directory) handle parameters of a file or directory within a particular server file 

10 system 175. The metadata 132 further allows identification or selection of a particular 
server computer system 170 to which the adaptive transaction processor 131 forwards a 
resulting mapped server access operation 147 within a server file access transaction 145. 

Within the adaptive load balancer 130, the adaptive transaction processor 131 
operates one or more appropriate data (i.e., file) access protocols such as NFS and/or 

15 CIFS to communicate with each of the server computer systems 170 to access to the 

respective server data systems 155 (i.e., server file systems in this example embodiment). 
Likewise, the adaptive transaction processor 131 can receive a server transaction 
response 148 (e.g., an NFS response) from the server computer system 170 (to which the 
server data access transaction was forwarded) and can use the metadata 132 to convert, 

20 map or otherwise translate this response 148 back into a client data access response 1 1 8 
that the adaptive load balancer 130 returns to the original requesting client computer 
system 120. In this manner, in one embodiment the adaptive transaction processor 131 
operates to present a collective set of server file systems 175-1 through 175-N that each 
have a respective set of files 180-1 through 180-N available as an aggregated set of files 

25 without identifying to the client computer systems 120 that the files are stored on 

different server computer systems 170. The adaptive load balancer 130 uses the metadata 
132 associated with the virtual file system to manage access to the aggregated sets of files 
within the server computer systems on behalf of client computer systems requesting 
access to files via the virtual file system 135. Further operation of an adaptive load 

30 balancer 130 in accordance with embodiments of the invention will be explained below 
in a series of flow charts. 



Attorney Docket: ACO03-02 

15 

Figure 2 is a flow chart of processing steps that the adaptive load balancer 130 
performs to process client data access transactions in accordance with one embodiment of 
the invention. The processing steps in Figure 2 show the general processing of the 
adaptive transaction processor 131 operating in a single load balancer 130. Operation of 

5 multiple adaptive load balancers 130 operating in conjunction with each other to perform 
such functions as data, service and file replication and migration between different 
groups of servers will be presented later after the general operation of transaction 
processing is explained in relation to the single load balancer 130 illustrated in Figure 1. 
In step 200, the adaptive load balancer 130 of this embodiment of the invention 

10 presents a virtual data system 135 to one or more client computer systems 120. The 
virtual data system 135 provides access to an aggregated set of data, files or services 
available from a plurality of server data systems 175 respectively operating within a 
plurality of server computer systems 170. As noted in the above example, in one 
embodiment the virtual data system 135 may be, for example, a virtual file system and 

1 5 the server data systems are server file systems respectively associated with each of the 
plurality of server computer systems 170. A file system example is used herein to 
explain the general operation of the adaptive load balancer 130. In an alternative 
configuration that will be explained in more detail later, the virtual data system 135 may 
provide an aggregation of other types of server data systems 175, such as web services. 

20 To provide a virtual file system 1 35, in sub-step 201 , the adaptive load balancer 

130 aggregates a set of files 180-1 through 180-N and directories accessible in the 
respective server file systems 175 of each of the plurality of server computer systems 170 
to appear to client computer systems 120 as the virtual file system 135. 

In step 202, the adaptive load balancer exposes the collective set of files and 

25 directories 180-1 through 180-N aggregated in the virtual file system 135 to client 

computer systems 120 using a file access protocol compatible with the client computer 
systems 120 such that virtual file system 135 is presented to client computer systems as a 
single virtual file system within that protocol. This provides a single point of access to 
the files and directories of the aggregated set of files and directories of each of the 

30 plurality of server computer systems 170. The file access protocol may be, for example, 
the Network File System (NFS) protocol or the Common Internet File System (CIFS) 
protocol. 
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In step 203, the adaptive load balancer receives a client data access transaction 
115 from a client computer system 120. The client data access transaction 115 specifies a 
data access operation 1 17 to be performed relative to the virtual data system 135 
presented to the client computer system 120 by the adaptive load balancer 130. In the file 

5 system example, the client data access transaction 1 17 is a file system request for access 
" to information associated with a file presented to the client computer system 120 within 
the virtual file system 135. The adaptive load balancer 130 operates in conjunction with 
the server file systems 175 of each of the server computer systems 170 according to the 
NFS protocol and/or the CIFS protocol as well over the network 160. 

10 In step 204, the adaptive load balancer processes the client data access transaction 

1 15 in relation to metadata 132 associated with the virtual data system 135. In one 
embodiment, the metadata 132 is information maintained by the adaptive load balancer 

130 to map or translate virtual file parameters within file system requests 1 17 provided 
from client computer systems 120 for access to a file presented within the virtual file 

1 5 system 135 to corresponding physical file parameters of an instance of a file (e.g., within 
a set of files 180) in at least one of the server file systems 175 maintained by at least one 
of the server computer systems 170. Details of this mapping and translation operation 
will be presented shortly in subsequent flow charts. 

In step 205, the adaptive load balancer determines if the data access operation 117 

20 (specified in the client transaction 1 1 5) requires access (or not) to data available from the 
plurality of server data systems 170. In certain instances, depending upon the specific 
data access operation 117 specified by the client 120, the adaptive transaction processor 

131 may or may not be required to perform direct access to a server computer system 
1 70. As an example, the adaptive transaction process 1 3 1 can process certain NFS 

25 operations using only the metadata 1 32 without requiring creation and transmission of a 
corresponding server data access transaction 145 to any server 170. A specific example 
is the NFS READDIR operation. This is because such NFS operations do not require or 
involve access to or manipulation of actual file data contained within specific files 180. 
Rather, such operations involve access to data about those files, such as the name of a file 

-30 or the location of a file (e.g. directory or path), or the existence of a directory. 

As such, embodiments of the invention are based in part on the observation that 
certain data access operations can be satisfied (i.e., performed with a response 116 
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transmitted back to the client 120) without requiring direct access to a particular file in a 
particular server 1 70. Other types of data access operations 1 1 7, such as, for example, 
NFS READ, WRITE, GETATTR, and SETATTR require direct access to data within 
files or data within a server file system 175. In such cases, the adaptive transaction 
5 process 131 operates as will be explained to translate the client data access transaction 
115 into a corresponding server data access transaction 145 for forwarding to a specific 
server computer system 170. Further details on this will be explained shortly. 

In step 205, if the data access operation 1 17 (specified in the client transaction 
115) requires access to data available from the plurality of server data systems 170, 
1 0 processing proceeds to step 206. 

In step 206, the adaptive load balancer processes the client data acces transaction 
115 using the metadata 132 to create a server data access transaction 145 that is 
transferred to a server computer system 170 to carry out the data access operation 117 
specified by the client computer system 120. Further details of the processing performed 
1 5 in step 206 will be explained shortly in Figure 3. 

Returning attention to step 205, if the data access operation 117 (specified in the 
client transaction 1 15) does not require access to data available from the plurality of 
server data systems 170, processing proceeds to step 207. 

In step 207, the adaptive load balancer accesses metadata 132 associated with the 
20 virtual data system to complete processing of the data access operation specified by the 
client data access transaction. This can involve, for example, accessing directory or file 
mapping information to satisfy NFS operations such as NFS LOOKUP, READDIR, 
STATFS or other operations not requiring specific access to the files in server file 
systems 175. 

25 Figure 3 is a flow chart of processing steps performed in one embodiment of the 

invention to processes the client data access transaction 115 using the metadata 132 to 
create a server data access transaction 145 that is transferred to a server computer system 
170 to carry out the data access operation 117 specified by the client computer system 
120. In other words, the steps in Figure 3 are sub-steps performed in step 206 of Figure 

30 2. 

In step 208, for operations that do require access to a server 170, the adaptive load 
balancer 130 translates, using the metadata 132 associated with the virtual data system 
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135, the client data access transaction 115 into a corresponding server data access 
transaction 145 for access to the data 180 available from one of the plurality of server 
computer systems 170 according to the data access operation 1 17 specified within the 
client data access transaction 115. Generally, translation involves mapping web service, 
5 data or file parameter information specified in the data access operation 1 1 7, such as file 
handles and/or other file parameters or web service parameters, into corresponding server 
parameters and further includes identification of a specific server 170 to process the 
resulting server transaction 145 (produced form the translation). Further details of this 
translation with respect to a file system will be explained shortly. 

10 Once translated, in step 209, the adaptive load balancer 130 forwards the server 

file access transaction 145 to a selected one of the plurality of server computer systems 
170 specified by (i.e., selected using) the metadata 132 for processing of the file access 
operation 1 1 7 specified by the client file access transaction 1 1 5 by that selected server 
computer system 170. Once the server computer system 170 processes the requested 

15 server transaction 145, it produces a server transaction response 148 that the server 170 
transmits back to the adaptive load balancer 130. 

In step 210, the adaptive load balancer 130 receives a server transaction response 
148 from the server computer system 170 to which the server file access transaction 145 
was forwarded (in step 207). 

20 In step 2 1 1 , the adaptive translation processor 1 3 1 operating in the adaptive load 

balancer 130 translates, using the metadata 132 associated with the yirtual file system 
135, the server transaction response 148 into a client file access response 1 16. Generally, 
this reverse translation involves mapping resulting web service, data or file parameter 
information specified in the server transaction response 148, such as file handles and/or 

25 other file or service parameters specific to the responding server computer system 170, 
into corresponding virtual data system parameters (useable by the clients 120) and further 
includes identification of the specific client 120 to process the resulting client data access 
response 116 (produced from the reverse translation). 

In step 212, the adaptive load balancer 130 forwards the client data (i.e., file in the 

30 file system example) access response 1 16 to the client computer system 120 from which 
the client file access transaction 115 was received. In this manner, the virtual file system 
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135 provides the access to the file requested by the client while insulating the client from 
details of which particular server contains the file. 

The aforementioned processing steps provide an overview of the general 
operation of an adaptive load balancer 130 configured according to embodiments of the 
5 invention. The flow charts that follow provide details of the aforementioned processing 
steps. 

Figure 4 is a flow chart of processing steps that the adaptive load balancer 130 
performs in accordance with embodiments of the invention to maintain the metadata 132 
used in performing the translation and mapping process of virtual data system parameters 

10 associated with client data access transactions 115 into corresponding parameters useable 
within the server data systems 175. 

In step 300, the adaptive load balancer 130 maintains the metadata 132 associated 
with the virtual file system 135 in at least one forwarding table (see example below) 
containing forwarding table entries (rows) that provide a mapping of virtual file system 

1 5 parameters to physical file system parameters. The mapping can including, for example, 
a mapping of virtual file identifiers (e.g., virtual file system file handles) corresponding to 
each available file accessible by client computer systems 120 in the virtual file system 
135 to both a corresponding (one or more) physical file identifier (i.e., server file system 
file handle(s)) and an identity of at least one server computer system of the plurality of 

20 server computer systems at which an instance of that file can be accessed using that 

corresponding physical file identifier. Forwarding tables can include directory location 
mapping tables, directory file mapping tables, and active transaction tables as explained 
below. 

In step 301, the adaptive load balancer 130 maintains a directory location 
25 mapping table (example below) containing a mapping of virtual file identities of parent 
and child directories within the virtual file system 135. The parent and child directories 
represent an aggregation of directory structures (i.e., parent and child sub-directories) 
present within respective server file systems 175 of the plurality of file servers 170. 

An example of a directory location mapping table containing a mapping of virtual 
30 file system directories to physical (i.e., server) file system directories stored in one or 
more server file systems 175 is shown in the table below: 
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Source or Parent 
Virtual File Handles 
(SFH) 


Lookup File 
Handles (LFH) 
(lookup value or 

component) 


Child Virtual File 

T T 1 1 

Handles 
(VFH) 




/home 


• 


/home 


/home 


./usr 


/home/usr 


/home/usr/ 


./Joe 


/home/usr/Joe 


/nome/usr 


./ odliy 


/l"*r*m<*/iici*/^c*1 1\f 

/iiuiTic/ ubr/ oaiiy 


/home/usr/Joe 


JoeFilel.doc 


12345 


/home/usr/Joe 


JoeFile2.doc 


34567 


/home/usr/Sally 


SallyFile-Y.txt 


56789 









EXAMPLE DIRECTORY LOCATION MAPPING TABLE 



In the above example directory location mapping table, left-hand column labeled 
5 Parent Virtual File Handle (SFH) contains example file handles (expressed here as 

directory names) of directories that the adaptive load balancer 130 presents to the client 
computer systems 120 via a data access protocol such as NFS or CIFS (e.g., via exporting 
the "/home" directory as a mount point). The middle column contains Lookup File 
Handles (LFH) that specify a target directory for which a file handle is to be obtained. 
1 0 The file handles in the LFH column thus contain the target names of files and/or sub- 
directories within the parent or source directory specified by the SFH (Column 1). The 
corresponding (i.e., resulting) file handles of each LFH are provided in the right-hand 
column labeled Child Virtual File Handles (VFH). 

The above example Directory Location Mapping Table corresponds to an NFS or 
1 5 CIFS file system directory tree structure presented by the virtual file system 135 that 
appears generally as follows: 



21 
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15 



/home 

/usr 

/Joe 

JoeFilel.doc 
JoeFile2.doc 

/Sally 

SallyFilel.txt 



EXAMPLE VIRTUAL FILE SYSTEM DIRETORY STRUCTURE 



Note that indentation towards the right in the above example indicates child files 
or sub-directories contained within upper-level or parent directories that are contained 
above and to the left. Thus /usr is a child or sub-directory of /home and contains two 
sub-directories itself, /Joe (i.e., for a user named Joe) and /Sally (i.e., for a user named 

20 Sally). Joe's /home/usr/Joe sub-directory contains two physical files, JoeFilel .doc and 
JoeFile2.doc, while Sally's sub-directory /home/usr/Sally contains one example file 
SallyFile.txt. Note that the ". . ." indicates that other files or directories could be 
contained within the directories and that this is a simple example only. 

As will be explained, the adaptive transaction process 1 3 1 can create a directory 

25 location mapping table for a number of different directory structures exported as mount 
points within the server file systems 175 from each serve computer system 170. Creation 
of this table can be done via a traversal, using NFS or CIFS commands (depending upon 
what protocol a particular server supports), of the entire set of server file systems 175-1 
through 175-N upon adaptive load balancer installation. In other words, the metadata 

30 tables can be populated, from scratch, given the identity of a set of servers containing file 
systems that are to be aggregated by the adaptive load balancer as explained herein. 
Once the server and file system identities are known, the system of the invention can 
populate the metadata for each file system by traversing the entire directory structure of 
the file system to identify each file and directory path thus creating the aforementioned 

35 metadata table information. Once created, the adaptive transaction process 131 can 
receive client data access transactions 115 containing, for example, NFS or CIFS data 
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access operations 117 such as NFS LOOKUP commands and can use the directory 
location mapping table within the metadata 132 to resolve a particular requested a virtual 
file handle into the appropriate virtual file handle of the file or directory that the client 
120 seeking access to within the virtual file system 135. 
5 As an example, a client is seeking access (e.g., via a sequence of NFS lookup 

commands) to a file having the full directory path /home/usr/joe/JoeFilel.doc can provide 
a sequence of one or more NFS LOOKUP operations 1 17 in the adaptive transaction 
process 1 3 1 and can use the above example directory location mapping table to identify 
the virtual file handle (VFH) "12345" associated with that file in the virtual file system 

10 135. Note that the example file handles "12345" and so forth represented here as 
examples only and do not represent actual file handles used by NFS of CIFS. 

Returning attention to the flowchart of processing steps in Figure 4, in step 302, 
the adaptive load balancer further maintains, as metadata 132, a set of directory file 
mapping tables, one for each directory in the virtual file system, and each directory file 

15 mapping table contains a mapping of virtual file identities (i.e., virtual file handles) of 
files within the virtual file system 135 of (i.e., in) that directory to physical file identities 
(i.e., physical server file handles) of a corresponding file 180 within a server file system 
1 75 operating on a respective server computer system 170. 

An example of a directory file mapping table containing a mapping of virtual file 

20 system parameters (e.g., virtual file handles) to physical (i.e., server) file system 

parameters (e.g., server file handles) for files stored in one or more server file system 
directories is shown in the table below: 



Virtual file handles 
(VFH) 


Physical file handles 
(PFH) 


Server Computer 
System identity 


Other parameter 
mappings 


12345 


ABCDE 


170-1 




34567 


CDEFG 


170-1 




34567 


PQRST 


170-2 




56789 


EFGHI 


170-N 













25 EXAMPLE DIRECTORY FILE MAPPING TABLE 

The example directory file mapping table above maps virtual file handles of files 
or directories within the virtual file system 135 to physical or server file handles of actual 
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files stored within server computer systems. In addition, example directory file mapping 
table includes the identity of one or more server computer systems 170 at contain an 
instance or copy of that file corresponding to the virtual file handle in column 1 . Note 
that in this example, the file JoeFile2.doc is known to client applications 125 by using the 
5 virtual file handle 34567 and maps to two replicated server instances or copies of that 
file. The first copy has a physical file handle "CDEFG" and resides within the server file 
system 175-1 within the server computer system 170-1 in Figure 1 whereas the second 
copy has a physical file handle "PQRST" and resides within the server file system 175-2 
operating within the server computer system 170-2. 

1 0 Using a directory file mapping table, upon receipt of a client file access 

transaction 115 specifying a file access operations 1 17 such as a NFS READ or WRITE 
operations to a specific file identified by a virtual file handle (e.g., READ from file 
12345), the adaptive transaction process 131 can use the directory file mapping table to 
identify an appropriate physical or server file handle (PFH, Column 2 in example above) 

15 of a corresponding file within a server file system 175 on a particular server 170 in order 
to carry out the requested data access operation 117. In one embodiment, there can be 
multiple directory file mapping tables, such as a separate directory file mapping table for 
each directory listed in the directory location mapping table. Multiple directory file 
mapping tables can speed up access to the required mapping information as opposed to 

20 searching a single very large table for file handles of interest. 

Returning attention again to the flowchart of processing steps in Figure 4, in step 
303, the adaptive load balancer 130 also maintains, in this embodiment, an active 
transaction table that associates client file access transactions 1 15 to corresponding server 
file access transactions 145. An example active transaction table is shown below: 

25 



Client/Virtual 

Transaction 

Identification 


Client 
Identity 


Virtual 

Data/File 

Parameters 


Server/Physical 

Transaction 

Identification 


Server 

Data/File 

Parameters 


Server 
Identity 


CT-1 


125-1 


12345... 


ST-1 


ABCDE... 


170-1 


CT-2 


125-2 


34567... 


ST-2 


PQRST... 


170-2 


CT-3 


125-3 


56789... 


ST-3 


EFGHI... 


170-N 



























EXAMPLE ACTIVE TRANS CATION TABLE 
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According to the operation of data access protocols such as NFS and CIFS, each 
data access operation 1 1 7 submitted and being serviced by the adaptive transaction 
processor 1 3 1 has an associated transaction identification. Accordingly, each client data 
5 access transaction 1 15 has as associated client transaction identification CT-Y, where Y 
in the table above represents a variable or number identifier for a currently active NFS 
transaction. By currently active, what is meant is an NFS data access operation 1 1 7 that 
is being serviced by the adaptive load balancer 130 and that is not yet complete. The 
adaptive transaction processor 1 3 1 maintains information within the active transaction 

10 table along with an identity of the client that submitted the transaction 1 15 to the adaptive 
load balancer 130. One purpose of the active transaction table is to quickly provide a 
return mapping of server transaction responses 148 for forwarding to the appropriate 
client computer system that originated a client transaction 115. 

In particular, once the adaptive transaction processor 131 converts the client file 

15 data access transaction 115 into a corresponding server data access transaction 145, the 
server data access transaction 145 will likewise have a separate but corresponding server 
transaction identification. By maintaining a table that corresponds or maps client 
transaction identifications to server transaction identifications, server transaction 
responses 148 can be quickly mapped back to respective client transaction identifications 

20 of client data access transactions 1 15 that caused creation of the server transaction 

response 148. Accordingly, the active transaction table can contain information linking 
or associating client and corresponding server transactions and can enable the adaptive 
transaction process or 131 to quickly translate, map, correlate or otherwise substitute 
appropriate virtual file system parameters, such as sever file handles that a server 

25 computer system 170 uses within a server transaction response 148 with corresponding 
client file handle and parameter information (e.g., NFS flags and other attributes) for 
efficient conversion and forwarding of server transaction responses 148 as client 
transaction responses 1 16 to the appropriate client computer system 120. 

The metadata 132 in this example thus includes one or more directory location 

30 mapping tables, one or more directory file mapping tables and one or more active 
transaction tables, collectively referred to herein as forwarding tables. As will be 
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explained in detail, the adaptive load balancer uses the metadata 132 as a basis for 
supporting operation of the virtual file system 135. 

Figure 5 is a flow chart of processing steps that the adaptive load balancer 130 
performs in accordance with embodiments of the invention to receive a client file access 
5 transaction 1 1 5 containing a file access operation 1 1 7. 

In step 304, the adaptive load balancer receives the client file access transaction 
115. As an example, suppose client application 125-2 operating client computer system 
125-2 transmits a client file access transaction 115 that specifies a data access operation 
117 such as in NFS READ command to read from the file /home/usr/joe/JoeFile2.doc. 

10 This command would appear as "NFS READ 34567", by way of example only. Note 
that according to standard operation of the NFS protocol, to obtain the virtual file handle 
34567 of the file JoeFile2.doc, the client computer system 125-2 would have to had 
transmitted a series of NFS LOOKUP operations on subsequent portions of the directory 
path /home/usr/Joe/Joefile2.doc (i.e., performed NFS LOOKUP operations first on 

1 5 /home, then on /usr, then on /Joe, and then finally on JoeFile2.doc) and the adaptive 
transaction processor 131 would use the metadata 132 explained above to return 
corresponding file handles in response to each NFS lookup operation. Thus the example 
of NFS READ 34567 assumes this process has already taken place (and would have been 
performed as explained below for metadata-only data access operations 117). 

20 In step 305, the adaptive load balancer assigns a client transaction identity to the 

received client file access transaction 115, such as CT-2 in the example active transaction 
table shown above. Client transaction identities are sequentially assigned so that 
subsequently received client transactions 1 1 5 are each assigned different transaction 
identities. 

25 In sub-step 306, the adaptive load balancer 130 determines if the active 

transaction table contains an active transaction table entry that corresponds to the client 
transaction identity CT-2. This check is made in step 306 to determine if the client 
transaction 1 15 is a repeat or redundant transaction, in which case processing can proceed 
to step 308. Alternatively, if the client transaction identity CT-2 assigned to the client 

30 file access transaction 115 does not exist in the active transaction table, then this is a new 
client transaction 115 and processing proceeds to step 307. 
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In step 307, if the active transaction table does not contain an active transaction 
table entry (i.e., row) that corresponds to (i.e., that contains) the client transaction identity 
CT-2, the adaptive load balancer 130 creates an active transaction table entry (i.e., adds a 
new row or record to the table) containing the assigned client transaction identity CT-2 
5 along with an identity of the client computer system 125-2 (in column 2 of the above 
example active transaction table) from which the client file access transaction 115 was 
received. Also in this step, the transaction table entry can be populated (by the adaptive 
transaction process 131) with client specific information such as NFS attributes, flags, a 
client file handle, and so forth to speed up reverse translation of server responses 

10 explained later. The adaptive transaction process 131 can store this information in the 
virtual file parameters column (shown in the example table above) for later use. 

In step 308, for duplicate transactions 115, the adaptive load balancer 130 
identifies that the client file access transaction 115 received from the client computer 
system is a duplicate client file access transaction within the active transaction table. A 

15 duplicate may be received, for example, if a client data access response 1 16 is not 
received by a client computer system within NFS timeout period. 

In step 309-A, the adaptive load balancer 130, in response to identifying that the 
client file access transaction 1 1 5 is a duplicate, determines whether a response has 
already been received from the server for this client file access transaction. If so, in step 

20 309-B the adaptive load balancer 130 returns the response previously received from the 
server as the client data access response 116 and then proceeds to step 304 to receive 
another client data or file access transaction 115 (from the same or a different client 
computer system). If in step 309-A, adaptive load balancer 130 determines the server has 
not yet responded to this transaction then it proceeds to step 310 which will result in a 

25 new request to the server. 

After processing of step 307 is complete, the adaptive transaction processor 131 
has successfully received a client data access transaction 1 1 5 and processing can proceed 
to the flow chart of processing steps shown in Figure 6 to translate this transaction 115 
into a corresponding server data access transaction 145. 

30 Figures 6 A and 6B are a flow chart of processing steps that the adaptive load 

balancer 130 performs in accordance with embodiments of the invention to translate the 
client data access transaction 115 into a corresponding server data access transaction 145. 
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In step 31 0, the adaptive load balancer 130 translates, using the metadata 132 
associated with the virtual file system 135, the client file access transaction 115 into a 
server file access transaction 145. Sub-steps 3 1 1 through 319 explain details of this 
processing. 

5 In step 311, the adaptive load balancer 130 obtains a virtual file identifier 

specified in the client file access transaction 115. Using the example above of the data 
access operation "NFS READ 34567," the virtual file identifier is "34567". 

In step 312, the adaptive load balancer 130 matches the virtual file identifier (e.g., 
34567) specified in the client file access transaction 1 15 to a matching forwarding table 

10 entry in a forwarding table (e.g., the directory file mapping table that maps virtual file 
handles to physical or server file handles) to identify a corresponding physical file 
identifier contained in the matching forwarding table entry. Note that when matching a 
directory, the directory location mapping table is used. The NFS protocol can indicate 
whether or not the file handles associated with the directory or a file. 

1 5 In sub-step 3 1 3, in the case of a virtual file identifier corresponding to a 

subdirectory, the adaptive load balancer 130 compares a directory portion of the virtual 
file identity (e.g., /home or /usr or /Joe) to the directory location mapping table to identify 
a destination virtual file identity of a sub-directory in the virtual file system 135 that 
contains a file (e.g., JoeFile2.doc) to be accessed according to the file access operation 

20 specified in the client file access transaction 115. 

In sub-step 3 14, in situations when the virtual file identifier specified within a 
data access operations 1 17 is a file handle of the file, the adaptive load balancer 130 
identifies a specific directory file mapping table within a set of directory file mapping 
tables that corresponds to the destination virtual file identity of the directory in the virtual 

25 file system that contains a file to be accessed according to the file access operation 117 
(e.g., NFS READ 34567) specified in the client file access transaction 115. In other 
words, since there may be multiple directory file mapping tables, one for each 
subdirectory within the virtual file system 135, and processing in sub-step 314 identifies 
the proper directory file mapping table that maps virtual file handles (e.g., the 34567 file 

30 handle for the JoeFile2.doc file) to physical file handles (e.g., CDEFG or PQRST in the 
above example table) for all files in the directory containing the file for which access is 
requested (i.e., Joefile2.doc), known to the client via the series of NFS lookup operations. 
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At this point in processing, the adaptive transaction processor 131 has thus identified a 
directory file mapping table containing one or more mappings for entries for the virtual 
file handle (e.g., 34567) specified within the file access operation 117 received in the 
client transaction 115. 
5 In step 3 1 5 5 the adaptive load balancer 1 30 creates the server file access 

transaction 145 by replacing the virtual file identifier (34567) specified in the client file 
access transaction 115 with the corresponding physical file identifier (e.g., one of 
CDEFG or PQRST) contained in the matching forwarding table entry of the directory file 
mapping table. 

1 0 Figure 6B shows the processing details in sub-steps 3 1 6 and 3 1 7 that explain the 

processing of step 315 for the flow chart in Figure 6A in a more detail. 

In particular, in Figure 6B, selection of a server computer system is performed in 
sub-step 316 in which the adaptive load balancer 130 compares, within the specific 
identified directory file mapping table, a file portion (i.e., file handle) of the virtual file 

1 5 identity to directory file mapping table entries (i.e., rows) to identify at least one 

matching directory file mapping table entry that contains the file portion of the virtual file 
identity in order to identify a server computer system 170 of the plurality of server 
computer systems 170-1 through 170-N that can be used to access that file, as well as to 
identify a physical file identity (i.e., server file handle) of a file on that identified server 

20 computer system 1 70 that corresponds to the file to be accessed according to the file 
access operation specified in the client file access transaction 115. 

Note in the example directory file mapping table shown above, there are two 
matching entries that each contain the virtual file handle 34567. This indicates that 
multiple server computer systems 170-1 and 170-2 each contain a copy of the data, 

25 information or file referenced by this virtual file handle. In particular, server computer 
system 170-1 contains a copy of this file referenced using the physical file handle 
CDEFG, while server computer system 170-2 also contains a copy of this file referenced 
via the server or physical file handle PQRST. In such cases, the file is said to be 
"replicated" between multiple server computer systems 170. 

30 To handle replication, in step 317, the adaptive load balancer 130 identifies a 

plurality of matching directory file mapping table entries that each contain the file portion 
of the virtual file identity, thus indicating that the file to be accessed according to the file 
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access operation specified in the client file access transaction is replicated in at least two 
locations within the plurality of server computer systems. 

In step 31 7, the adaptive transaction processor 131 can use various criteria to 
select which particular copy of the file will be chosen for application of the client's 
5 requested data access operation 1 1 7 win more than one directory file mapping table entry 
matches the virtual file handle. Factors that can be used in making a selection between 
which physical file handle to use (and thus which choice of server computer system to 
select) can include such things as performance metrics associated with each server 
computer system containing a copy of the file, network congestion that might be 
10 experienced when communicating with each server computer system 170 containing a 
copy of file, and other considerations. Assume for the example command NFS READ 
34567 that the adaptive transaction processor 131 selects the matching entry in the 
directory file mapping table corresponding to the file handle PQRST (i.e., the second 
matching entry) for the server computer system 170-2. The newly create server data 
1 5 access transaction 145 thus appears as "NFS READ PQRST." 

In step 318, the adaptive load balancer 130 assigns a server transaction identity 
ST-2 to the newly created server file access transaction 145. 

In step 319, the adaptive load balancer 130 stores the server transaction identity 
ST-2 in the active transaction table entry that contains the client transaction identity CT-2 
20 of the received client file access transaction 1 1 5 that was translated to the created server 
file access transaction 145. 

In this manner, the adaptive load balancer 130 creates a server data access 
transaction 145 and establishes the appropriate transaction mapping within the active 
transaction table. 

25 Figure 7 is a flow chart of processing steps that the adaptive load balancer 130 

performs in accordance with embodiments of the invention to forward a server data 
access transaction 145 to appropriate server computer system 170 for processing in 
relation to a server file system 175. 

In step 320, the adaptive load balancer 130 forwards the server file access 

30 transaction to a selected one of the plurality of server computer systems 170. Some steps 
321 through 323 show details of this process. 
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In step 321, the adaptive load balancer 130 identifies, from the matching 
forwarding table entry (i.e., the server computer system identity, of the directory file 
mapping table shown above), the server computer system at which an instance of the file 
can be accessed using the corresponding physical/server file identifier (PFH). 
5 In step 322, the adaptive load balancer 130 forwards the server file access 

transaction 145 to the server computer system 170 (e.g., 170-2 for the above example 
NFS READ PQRST server data access operation) corresponding to the identified server 
computer system (from Column 3 of the directory file mapping table) at which an 
instance of that file (i.e., JoeFile2.doc) can be accessed. Communications between the 

10 adaptive load balancer 130 and the server computer systems 170 can utilize, for example, 
the same data access protocol that is performed between the client computer systems 120 
in the adaptive load balancer 130, such as NFS or CIFS. Once the server computer 
system 170 receives the server data access transaction 145, the server file system can 
processes this transaction in accordance with the specified data access operation 147 

1 5 contained therein and returns a server transaction response 148 to the adaptive load 

balancer 130. From the server file system's perspective, the adaptive load balancer 130 
appears to be a client application requesting access to a particular file, data or service 
within the server computer system 170. 

In step 323, the adaptive load balancer 130 receives a server transaction response 

20 148 from the server computer system 170 to which the server file access transaction 145 
was forwarded in step 322. Once the adaptive transaction processor 131 receives the 
server transaction response 148, this response 148 is translated into a client data access 
response 1 16 as explained below. 

Figure 8 is a flow chart of processing steps that the adaptive load balancer 130 

25 performs in accordance with embodiments of the invention to translated server 

transaction response 148 into a client data access response 1 16 or transmission to a client 
computer system 120. Generally, the processing in Figure 8 performs a reverse 
translation of the server transaction response 148 using the above explained data 
structures and tables as explained above to produce a corresponding client data access 

30 response 116. 

In step 324, the adaptive load balancer 130 translates, using the metadata 132 
associated with the virtual file system 135, the server transaction response 148 into a 
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client file access response 116. Details of this processing are illustrated in sub-steps 325 
through 327. 

In step 325, the adaptive load balancer 130 obtains a physical file identifier (e.g., 
PFH) specified in the server transaction response 148. In the file system example, the 
5 physical file identifier is a server file handle corresponding to the server file handle 
specified in the server data access operation 147 transmitted to the server computer 
system 170 within the server data access transaction 145 as explained above. 

In step 326, the adaptive load balancer 130 matches the physical file identifier 
specified in the server transaction response 148 to a matching forwarding table entry in at 

10 least one forwarding table to identify a corresponding virtual file identifier (e.g., the 

matching virtual file system handle) contained in the matching forwarding table entry. In 
other words, in steps 325 and 326, the directory file mapping table can be used to perform 
a reverse mapping of the physical file handle to virtual file handle. 

In an alternative embodiment invention, instead of using the physical file handle 

1 5 specified by the server file system within the server transaction response 148 as a key in 
the metadata 132 to perform a reverse mapping, the server transaction identification can 
be used as an index in the active transaction table in order to identify a corresponding 
client transaction identification that the server is responding to. Using this information, 
the active transaction table can provide virtual data or file parameters that correspond to 

20 server data file parameters in the server transaction response 148 and translation of a 
server response can be done using the transaction table. 

In step 327, the adaptive load balancer 130 replaces the physical file identifier 
specified in the server transaction response 148 (e.g., PQRST) with the corresponding 
virtual file identifier (e.g., 34567) contained in matching forwarding table entry to create 

25 the client file access response 116. As explained above, this reverse mapping can either 
be performed with the active transaction table or with the directory file mapping table, 
each of which are generally referred to herein as forwarding tables containing for 
information for translation of requests and responses between clients and server computer 
systems through management within the adaptive load balancer 130. 

30 In step 328, the adaptive load balancer 130 forwards the translated client file 

access response 1 16 to the client computer system. Sub-steps 329 through 331 illustrate 
details of this processing in accordance with one embodiment of the invention. 
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In step 329, the adaptive load balancer 130 obtains a server transaction identity 
specified in the server transaction response 148. 

In step 330, the adaptive load balancer 130 matches the server transaction identity 
ST to an active transaction table entry containing that server transaction identity (e.g 5 . 

5 ST-2) in the active transaction table to obtain a client transaction identity (e.g. CT-2) that 
corresponds to that server transaction identity ST-2. 

In step 3 30- A, the adaptive load balancer 130 saves the response from the server 
in the active transaction table. This stored information will be used to respond to 
duplicate client data access transactions (Step 309-B explained above). 

1 0 In step 33 1 , the adaptive load balancer 130 forwards the client file access 

response 1 16 to a client computer system 120-2 associated with the client transaction 
identity CT-2 identified in matching active transaction table entry (i.e., Column 2 for the 
for ST-2 matching entry) within the active transaction table. Accordingly, this 
embodiment invention uses the transaction table to perform a reverse mapping of server 

15 responses 148 to corresponding client responses 116. 

Figure 9 is an architecture of a computing system environment configured in 
accordance with embodiments of the invention that is similar to that described above in 
Figure 1, except that in Figure 9, multiple adaptive load balancers (to this example, 130-1 
and 130-2) that operate in conjunction with each other to provide access to a plurality of 

20 server file systems 170-1 through 170-6. Operation of the load balancers 130-1 and 130- 
2 will be explained with respect to the flowchart of processing steps illustrated in Figures 
10 through 14. Generally however, the adaptive load balancer 130-1 manages access to 
files within the server computer system 170-1 through 170-3 and the second adaptive 
load balancer 130-2 manages access to files within the server computer systems 170-4 

25 through 170-6, though each can also access the other server group as well if needed (e.g., 
for migration or replication purposes). 

Figure 10 is a flow chart of processing steps that an adaptive load balancer 130 
performs in accordance with embodiments of the invention to carryout migration 
operations between files stored within the server computer system 170-1 through 170-6. 

30 In step 400, the adaptive load balancer 130-1 detects a trend of access to a file 

180-1 within the virtual file system 135 by tracking file access patterns to the file 180-1 
by client computer systems 120. 
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In step 40 1, as an example, the adaptive load balancer 130 detects frequent access 
to the file 1 80-1 over a time period. The frequent access can be made by many client 
computer systems 120-1 through 120-M or by a single client computer system (e.g., 120- 
1 ) or any combination thereof 

5 In step 402, in response to detecting the trend of access, the adaptive load 

balancer 130 performs a migration operation on the file 180-1 for which the trend is 
detected in order to manage access to the file 180. In this example, the migration 
operations is a replication operation. 

In step 403, the adaptive load balancer 130 replicates 196 the file 180-1 to at least 

10 one server computer system 170-4 that does not contain the file 180-1 within its file 
system 175-4 at the time of detecting frequent access to a file 180-1 . The replication 
operation can involve the adaptive transaction processor 131-1 using a sequence 196 of 
one or more NFS operations such as READS 196-1 and WRITES 196-2 to read 196-1 the 
file from the server file system 175-1 within the server computer system 170-1 and write 

15 196-2 a corresponding copy 180-1 of the file within the file system 175-4 in the server 
computer system 170-4. In addition, the adaptive transaction processor 131-1 can 
perform a metadata update operation 197 by informing the second adaptive transaction 
processor 131-2 operating within the second adaptive load balancer 130-2 of the 
existence of the copy of the file 180-1 within the server computer system 170-4. 

20 Alternatively, the replication can be carryout by having the adaptive load balancer 

130-1 appeared as a client computer system to the adaptive load balancer 130-2 and 
provide a sequence of access commands to cause creation of the file 181 within an 
appropriate server computer system 170-4 through 170-6 under management of the 
second adaptive load balancer 130-2. In other words, the first scenario the first adaptive 

25 load balancer 130-1 copies the file itself to the second server computer system 170-4 and 
then informs the second adaptive load balancer 130-2 so that the metadata 132-2 is 
properly updated. In the second or alternative scenario, the first adaptive load balancer 
130-1 operate as a client with respect to the second adaptive load balancer 130-2 thus 
causing the second adaptive load balancer 132 to create a second instance of the file 180- 

30 1 . In this manner, since multiple copies of the file for which frequent access was detected 
are now distributed within multiple locations, client computer systems are offered access 
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to this file from multiple adaptive load balancers must reducing the load or demand for 
the file from the first adaptive load balancer 131 the detected frequent access to the file. 

Sub-step 404 illustrates another alternative embodiment of the invention in which 
the adaptive load balancer 130 selects, as the server computer system for replicating the 

5 file, at least one server computer system that is of higher performance in relation to at 
least one other server computer system in the plurality of server computer systems 
available to store the replicated file. In this manner, this embodiment of the invention 
causes the copy of the file created during the read and write replication operations 196-1 
and 196-2 to be placed on a high-performance server computer system due to increased 

1 0 demand for access to the file by client computer systems. 

As a result of this embodiment of the invention, the virtual file system 135 
provided by the adaptive load balancer provides at least one file accessible to the client 
computer system that is replicated within the first and second file systems 175-1 and 175- 
4 on the first and second server computer systems 170-1 and 170-4. It is to be understood 

1 5 that embodiments of the invention are not limited to configurations in which groups of 
server computer systems are under control of certain adaptive load balancers 130. In an 
alternative arrangement, each adaptive load balancer 130-1 and 130-2 has equivalent 
access to all server file systems of the entire set of server computer systems 170-1 
through 170-6 and the metadata 132 is equally shared between adaptive load balancers 

20 130-1 and 130-2. In such a configuration, a single virtual file system 135 is presented by 
both adaptive load balancers 130. 

Figure 1 1 is a flow chart of processing steps that the adaptive load balancer 130 
performs in accordance with embodiments of the invention in which a trend of access to 
one or more files is detected as decreasing over time. 

25 In step 420 the adaptive load balancer 1 30 detects a trend of access to a file within 

the virtual file system by tracking file access patterns to the file client computer systems 
120. 

In step 421, the adaptive load balancer 130 detects infrequent access to a file over 
the time period. As an example, if a replicated file 180-1 exists in multiple server file 
30 systems 175-1 and 175-4 of multiple server computer systems 170-1 and 170-4 (as a 

result of the replication processing explained above with respect to Figure 10), it may be 
the case that over time, client demand for access to this file decreases and thus 
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maintaining replicated copies of the file within multiple server computer systems results 
in an inefficient use of server computer system storage space. In response to this trend of 
decreasing access, processing can proceed in one embodiment of the invention to step 
422 (i.e., in situations in which the file for which the trend of access is detected is 

5 replicated across a plurality of server computer systems). Alternatively, if only a single 
copy of the file exists within a single server computer system associated with the virtual 
file system 135, processing can proceed to step 426 to be explained later. 

In step 422, the adaptive load balancer 130 performs a migration operation on the 
file. In this example, the migration operation can be removal of replicated copies of the 

10 file and can further include accounting for server performance metrics to determine 

which server computer system 170 should maintain at least one (i.e., the last remaining) 
copy of the file. 

In step 423, the adaptive load balancer 130 identifies, using metadata 132 
associated with the virtual file system 135, that the file 180-1 is replicated across a 
1 5 plurality of server file systems of respective server computer systems (e.g., 1 70- 1 and 
170-4). 

In step 424, in response to identifying that the file is replicated, the adaptive load 
balancer 130 instructs at least one server computer system (e.g., 170-4) that maintains a 
replicated copy of the file within its server file system to remove the replicated copy 180- 

20 1. This makes the storage space occupied by this replicated copy of the file 180-1 now 
available for other uses within the virtual file system 135. 

As an enhancement to the embodiment discussed above respect to step 424, in 
step 425, the adaptive load balancer 130 selects, as the server computer system from 
which the replicated copy of the file is to be removed, at least one server computer 

25 system that contains a replicated copy of the file 180-1 and that is of higher performance 
relative to other server computer systems in the plurality of server computer systems. In 
this manner, replicated copies of the file are removed (i.e., deleted) from high- 
performance server computer systems 170 since demand for access to the file(s) has 
decreased. This makes additional storage space available on those high-performance 

30 computing systems for storage of files for which demand is greater. 

As explained above, in situations in which a singular copy of a file exists within 
only a single server computer system associated with the virtual file system 135, if a 
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trend of access to this file is detected that indicate a decreased requirement for access to 
this file, processing can proceed from step 421 to step 426. 

In step 426, the adaptive load balancer 130 migrates the file 1 80 from a higher 
performing server computer system to a lower performing server computer system. In 
5 this manner, the embodiment of step 426 causes files that are less frequently accessed and 
that are replicated to be moved to lesser or slower performing server computer systems 
thus freeing up storage space and processing resources within higher performing server 
computer systems to handle access to files having higher demands or access 
requirements. 

1 0 Figure 12A and 12B are flow charts of processing steps that the adaptive load 

balancer 130 performs in accordance with embodiments of the invention to process data 
access operations that are metadata specific. As mentioned above, since the virtual data 
system 135 includes metadata 132 containing mapping information between the virtual 
data system parameters and physical or server data system parameters of information 

1 5 maintained in respective server computer systems, certain data access operations can be 
processed completely by the adaptive load balancer via access to the metadata 132 
without requiring translation of the data access operations into a corresponding server 
data access transaction 145. In other words, the adaptive transaction processor 131 can 
satisfy and process certain data access operations 1 17 by accessing only the metadata 

20 132. The processing steps 500 through 51 1 illustrate example embodiments of the 
invention that perform such processing. 

In step 500, the adaptive load balancer 130 processes the client file access 
transaction 1 15 in relation to metadata 132 associated with the virtual file system. 

In sub-step 501 in one embodiment, the file access operation specified by the 

25 client file access transaction is a metadata-only operation that the adaptive load balancer 
130 can perform by accessing the metadata associated with the virtual file system 135 
without requiring access to files 180 stored within respective file systems 175 of the 
plurality of computer systems 170. 

In an alternative operation, in step 502, the file access operation 1 17 in the client 

30 file access transaction 1 1 5 specifies an operation to be performed on directories and files 
of the virtual file system 135 that the adaptive load balancer 130 provides access to using 
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the Network File System protocol. Sub-steps 503 through 511 provide examples of NFS 
specific processing with respect to metadata 132. 

Step 503 shows example embodiments of step 502 in which the file access 
operation is a Network File System operation including at least one of a CREATE 
5 operation, a MKDIR operation, a READDIR operation and a STATFS operation. 

In step 504 and sub-steps 505 through 51 1, a specific example of processing is 
shown in which the file access operation is an NFS STATFS operation. An NFS 
STATFS operation is a request to obtain file system status concerning available storage 
space within the file system. If the adaptive load balancer receives such a command, the 

10 adaptive load balancer operates to report a collective amount space available within the 
aggregated server file systems 175 of each server computer system 170. 

In particular, in step 505, for STATFS,. the adaptive load balancer 130 accesses 
metadata 132 associated with the virtual file system 135 to complete processing of the 
STATFS file access operation 1 17 specified by the client file access transaction 115. 

15 In step 506, the adaptive load balancer 130 calculates an amount of storage space 

associated with each server file system 175 of the plurality of server computer systems 
170 that is provided within the virtual file system 135. This information can be 
maintained within the metadata 132 by calculating a sum total of the size of all files 
referenced by the metadata 132. 

20 Figure 12B shows sub-steps 507 through 510 that illustrate an example of 

processing an NFS STAFS command according to one embodiment of the invention. 

Specifically, in Figure 12B in sub-step 507, the adaptive load balancer 130 
calculates a total amount of current free space within each server file system 175 of the 
plurality of server computer systems that is provided within the virtual file system 135. 

25 The adaptive transaction processor 131 can obtain this value by having predetermined 
knowledge of the total amount of raw disk space available within each server file system 
175. From this amount, the adaptive transaction processor 131 can subtract the amount 
of space occupied by files identified within the metadata 132. The size of each file 
identified by the metadata 132 can be contained, for example, within the directory file 

30 mapping table within the "other parameter mappings" column, shown in the example 
directory file mapping table discussed above. This calculation thus produces a total 
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amount of current free space available within the virtual file system 135 but does not 
account for replicated files that could be deleted or removed. 

As such, in step 508, the adaptive load balancer 130 identifies a replicated amount 
of storage of replicated files within the set of server file systems 175 maintained by the 
5 respective server computer systems 170 within the virtual file system 135. 

In step 509, the adaptive load balancer 130 calculates a potential amount of total 
storage space as the total amount of current free space in addition to the replicated 
amount of storage of replicated files within the set of server file systems. 

In step 510, the adaptive load balancer 130 sets the amount of file storage space 

10 available for storage of data within the virtual file system equal to the potential amount of 
total storage space. In this manner, the amount of total storage space includes the space 
occupied by replicated copies of a file that could be deleted or removed if necessary in 
order to make additional space available for storing of new data. 

Returning attention now back to Figure 12 A, in step 51 1, the adaptive load 

1 5 balancer 1 30 provides a client file access response 1 16 to the requesting client computer 
system that indicates an amount of file, storage space available for storage of data within 
the virtual file system 135 that is based on the calculated amount of storage space 
associated with each server file system 175 and accounts for space occupied by replicated 
copies of the files that could be deleted. 

20 Figure 13 is a flow chart of processing steps that the adaptive load balancer 130 

performs in accordance with embodiments of the invention to process transactions that 
you require access to files within server file systems 175 in situations in which replicated 
copies of such files exist. As an example, the processing of the flow chart steps in Figure 
13 can be used to handle situations in which an NFS WRITE data access operation 1 17 is 

25 received that requires writing data to a file that contains multiple replicated copies within 
the virtual file system 135. 

In step 550 in this example embodiment, the file access operation specified by the 
client file access transaction is a file access operation that requires modification of a file 
within the virtual file system 135. In other words, in this embodiment the file access 

30 operation 1 17 requires the adaptive load balancer to create a server data access 

transaction 145 to access the particular instance of a file within a server computer system 
170. 
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In step 551, the adaptive load balancer 130 translates, using the metadata 132 
associated with the virtual file system 135 (as explained above), the client file access 
transaction 115 into a server file access transaction 145 for access to the file 180 
maintained within one of the plurality of server computer systems 170. Sub-steps 552 
5 through 554 explained such access according to embodiments of the invention with 
respect to replicated instances of files. 

In step 552, the adaptive load balancer 130 identifies if replicated copies of the 
file to be modified exist in the virtual file system within a plurality of server file systems 
of the plurality of server computer systems. 

10 In step 553, if replicated copies exist, the adaptive load balancer 130 translates, 

using the metadata 132 associated with the virtual file system 135, the client file access 
transaction 115 into a server file access transaction 145 for access to each copy of the 
replicated file maintained within the server file systems of the server computer systems 
(e.g., 180-1 on both the server computer systems 170-1 and 170-4 illustrated in Figure 9). 

1 5 In step 554, the adaptive load balancer 1 30 forwards the server file access 

transaction 145 to each of the plurality of server computer systems 170-1 and 170-4 (in 
the example of Figure 9) specified by the metadata 132 that contains a replicated copy of 
the file to be modified for processing of the file access operation on each replicated copy 
of the file. In other words, in the embodiment illustrated in Figure 13, a modification 

20 made to a file is carried out on each replicated copy of that file within each server file 
system 175 of each server computer system 170 that maintains a copy of that file. 

Figure 14 is a flow chart of processing steps that the adaptive load balancer 130 
performs in accordance with embodiments of the invention to provide an alternative to 
access management of replicated files within the virtual file system 135. In the 

25 embodiment illustrated in Figure 14, processing of a file access operation 1 17 is initially 
performed as explained in the initial example with respect to access to a single version of 
the file within a single server computer system 170. Thereafter however, the processing 
of steps 560 through 568 take place or occur upon receipt of the server transaction 
response 148. 

30 In step 560 in this example embodiment, the file access operation specified by the 

client file access transaction is a file access operation that requires modification of a file 
within the virtual file system by creation of a server file access transaction 145 for into a 
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specific server computer system containing a selected version of the file (that may or may 
not be replicated). Note is the files replicated, during the processing of server selection 
using the metadata 132 as explained above, one instance of the file can be designated as a 
master copy of the file and the server file system 175 that maintains a master copy would 

5 be selected as the file system to which the server data access transaction 145 is 
transmitted or forwarded. 

In step 561, the adaptive load balancer 130 receives a server transaction response 
148 from the server computer system (e.g., 170-1) to which a server file access 
transaction 145 was forwarded. 

10 In step 562, the adaptive load balancer 130 identifies that the server transaction 

response 148 indicates completion of modification of a file within a first server file 
system 175-1 of a first server computer system 170-1 as specified in the file access 
operation 117 specified by the client file access transaction 115. 

In step 563, the adaptive load balancer 130 identifies if replicated copies of the 

15 file that was modified exist within other server file systems 175-2 through 175-N of other 
server computer systems 170-2 through 170-N (i.e., other than the first server computer 
system 170-1). 

In step 564, if replicated copies of the file that was modified exist, then the 
adaptive load balancer 130 performs an update replica operation as explained below to 
20 update each replica copy of the file to contain the modifications made to the first or 
master version of the file stored within server computer system 170-1. 

In step 565, the adaptive load balancer 130 indicates, within the metadata 132 of 
the virtual file system 135 associated with the file that was modified, that the file in the 
first server file system 175-1 on the first server computer system 170-1 is a master copy 
25 of the file. The master copy of the file always contains the most complete or up-to-date 
version of the file. 

In step 566, the adaptive load balancer 130 indicates, within the metadata 132 of 
the virtual file system associated with the replicated copies of the file, that each replicated 
copy is a non-master copy of the file. 
30 In step 567, the adaptive load balancer 130 incrementally updates each replicated 

copy of the file that is indicated as a non-master copy of the file such that the replicated 
copies of the file contain the same content as the file that was modified. In this manner, 
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the processing reflected by steps 564 through 567 reflected embodiment of the invention 
in which replica copies of a file are incrementally updated (e.g., as time permits) after a 
master copy of the file is modified according to the data access operation 117 specified 
client. 

5 In an alternative configuration, in step 568, if replicated copies of the file that was 

modified exist within different server file systems 175, then the adaptive load balancer 
130 deletes each replicated copy of the file within respective server file systems 175 of 
server computer systems 1 70 that maintain a replicated copy of that file, such that file 
that was modified in the first server file system 175-1 is the only copy of that file that 

10 remains accessible to client computer systems 120 within the virtual file system 135. In 
this manner, if a replicated file exists in a modification is made to one instance of the 
replicated file, this embodiment of the invention causes the remaining replicated copies 
of the file to be deleted so that all accesses will now be directed to the modified version 
and no replicated copies will exist. Such embodiment would primarily be used for read- 

1 5 only file systems in which modification to replicated files would really take place. 

Alternative arrangements of the invention include rearranging the processing 
steps explained above in the flow charts in such a way that the overall effect of the 
invention is the same. It is to be thus understood by those skilled in the art that the 
particular arrangement of processing steps in many instances does not specify 

20 implementation of embodiments of the invention. As such, those skilled in the art of 
software, hardware and network device development and computer and network-related 
technologies will understand that there can be many ways and orders of representing the 
processing operations explained above and such alternative embodiments of the software 
code and/or hardware configurations will still achieve the overall effects, features and 

25 advantages of the invention as explained herein. 

In addition, embodiments of the invention are not limited to operation in a file 
system environment. Rather, embodiments of the invention provide an architecture for 
virtualizing any type of data system provided form a server computer system. Web 
services are another example and the term virtual data system includes, for example, 

30 virtualizing any type of object based distributed services architecture. 

Using web services as an example, the adaptive load balancer can be used as 
explained herein to provide a web based metadata layer between clients and servers to 
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allow access, for example, to a file or directory via a URL call from a client such as a 
web browser. The adaptive load balancer as explained herein can use the metadata to 
map a URL call received, for example, via HTTP, to a particular NFS or CIFS file access 
command transferred to a file server computer system on the back-end. As such, the term 
5 "data" as used in "virtual data system" herein includes such things as file, or any type of 
data or object in the sense that a web service is simply another type of object based 
distributed service architecture. In another alternative, HTTP is used as a front-end 
access method and the distributed metadata layer discussed above using NFS/CIFS is 
used to map requests to the back end servers. 

10 A web service is defined by a service definition object. Many web service 

instances of the same service definition can be instantiated and in a typical 
implementation, XML is the markup language used to describe the web service and 
WSDL (like an XML template for service creation) is the schema used to define the web 
service. Accordingly, just as the examples above explained how embodiments of the 

15 invention virtualize file objects, alternative embodiments provide virtualizations of 
service objects used in a web services environment. In such configurations, many web 
service instances can be created, migrated or aggregated together using the adaptive load 
balancer and metadata processing techniques explained herein (where the metadata is 
web services object information) to perform or provide a virtualized data service or 

20 system just as files are replicated, migrated or aggregated to provide a virtual file system. 
Service objects can contain external object attributes that embodiments of this invention 
represent in metadata much the same way that files contain the examples of metadata 
attributes explained above (e.g., path, file name, etc.). 

Accordingly, alternative embodiments of the invention provide a virtual data 

25 system by implementing an object infrastructure layer that is used to move web service 
objects around (i.e., between servers in response to web service requests) the same way 
files and file system requests are processed are as explained above. Accordingly, 
embodiments of the invention are not limited to operation in a file system application, but 
are intended to be generally applicable to any type of distributed service architecture. 

30 Accordingly, embodiments of the invention are not limited to the processing 
arrangements explained above. 



